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Abstract 

We analyze properties of a map / sending a unitary matrix U of size 
A'' into a doubly stochastic matrix B = f{U) defined by Bij = \Uij\'^. 
For any U we define its defect, determined by the dimension of the image 
Df{T!uU) of the space TuU tangent to the manifold of unitary matri- 
ces lA a.t U under the tangent map Df corresponding to /. The defect, 
equal to zero for a generic unitary matrix, gives an upper bound for the 
dimension of a smooth orbit (a manifold) of inequivalent unitary matrices 
mapped into the same doubly stochastic matrix. We demonstrate several 
properties of the defect and prove an explicit formula for the defect of the 
Fourier matrix _Fjv of size N . In this way we obtain an upper bound for the 
dimension of a smooth orbit of inequivalent unitary complex Hadamard 
matrices stemming from Fn- It is equal to zero iff N is prime and coin- 
cides with the dimension of the known orbits if A is a power of a prime. 
Two constructions of these orbits are presented at the end of this work. 
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1 Introduction 

Consider the set lA of unitary matrices of finite size N . For any unitary U we 
define a matrix B — f{U) with non-negative entries 

From the unitarity condition, UU* = 1, it follows that the resulting matrix B 
is bistochastic (also called si doubly stochastic), since the sum of elements in 
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each of its columns or rows is equal to unity. A bistochastic matrix B for which 
there exists a unitary (an orthogonal) U satisfying ^ is called unistochastic 
(orthostochastic) . For = 2 all bistochastic matrices are unistochastic, even 
orthostochastic, but for > 3 it is no longer the case [HH]- 
Our work is motivated by the following problem [S] H] . 

(*) For a given unitary U G Snd all other unitary matrices V G such 
that f{V) - B - f{U). 

This rather general question is closely related to several problems in vari- 
ous branches of mathematics and theoretical physics. For instance, taking the 
Fourier matrix F/v as the unitary U in question we get the flat bistochastic 
matrix, B = Jm with [Jat], ^ = 1/A^, so the above question reduces to the prob- 
lem of finding all unitarjQ complex Hadamard matrices of size N . This issue is 
related to construction of some *-subalgebras in finite von Neumann algebras 
[3 [71 [5] , analyzing bi-unimodular sequences or finding cyclic n-roots [21 [TU] and 
equiangular lines [TT] . The search for complex Hadamard matrices [51 [T^j is also 
motivated by the theory of quantum information processing 1141 115j . 

Furthermore, the general issue of specifying all unitary matrices such that 
their squared moduli give a fixed bistochastic matrix was intensively studied 
by high energy physicists investigating the parity violation and analyzing the 
Cabibbo-Kobayashi-Maskawa matrices [TU [iTl [18] . On the other hand, relation 
([ll is relevant to investigation of the semiclassical limit of quantum mechanics: 
for a given bistochastic B, representing the transition matrix of a Markov chain, 
one looks for the set of unitary matrices U which lead to the corresponding 
quantum dynamics [TU [20l [21] . 

To investigate problem (*) one uses the notion of equivalent unitary matrices 
[^, which differ by left and right multiplication by diagonal unitary matrices 
followed by arbitrary permutations of rows and columns. We suppose that for 
a generic unitary U all solutions of the problem (*) in a neighbourhood of U 
are equivalent, and we call such U isolated. However, for some non-typical 
unitaries it is not the case. It is therefore natural to ask for the dimension of a 
smooth orbit, i.e. a manifold, stemming from U, if one exists, of non-equivalent 
solutions V of problem (*) posed for a given unitary U. The upper bound for 
this dimension is obtained in this paper by computing the difference between 
the dimension (A^ — 1)^ of the minimal affine space B containing all bistochastic 
matrices, and the dimension of the image Df{TuU) of the space TjjU, tangent 
to l/l at under the tangent map Df. A non-negative integer number resulting 
from this calculation for a given unitary matrix U will be called its defect. We 
conjectured the defect to be equal to zero for a generic U, as a non-zero defect 
condition has the form of one additional equation imposed on entries of U. As 
we have been recently informed, the statement that the set of unitary matrices 
with a non-zero defect has measure zero within the set of all unitaries follows 
from an early work by Karabegov [22j . 

^We reserve the term 'complex Hadamard matrix' for a,n NxN complex matrix H satisfying 
H*H = HH* = N ■ Iff and Vi,j \Hij\ = 1, while l/\/JV ■ H is called a 'unitary complex 
Hadamard matrix'. Such matrices were called by Craigen 'unit Hadamard matrices' [5]. 
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Any non-zero value of the defect may be considered as a kind of quantifica- 
tion of the particular structure of U. For instance, the defect is positive if U is 
an orthogonal matrix of size N > 3, if U has a certain pattern i.e. some of its 
entries are equal to zero, or if U has a tensor product structure [53]. 

After the definition of the defect was first proposed in our previous work 
[T5] , this concept was used in very recent papers [571 UHl HH] to characterize 
complex Hadamard matrices. In this work we prove several properties of the 
defect, demonstrating its invariance with respect to the equivalence relation. 
We show that vanishing of the defect of U implies that U is isolated and we find 
a relation to an analogous 'span condition' by Nicoara 

The key result of this paper we regard to be an explicit formula for the defect 
of the Fourier matrix Fj^ of size N. Equivalent, more transparent forms of this 
formula were obtained by W. Slomczynski and are proved in appendix B. The 
defect vanishes iff N is prime, which implies the earlier statement by Petrescu 
[25j that the Fourier matrix is isolated if its dimension is a prime number. This 
in turn implies that the flat bistochastic matrix Jjv belongs to the interior of 
the set of unistochastic matrices [J, if iV is prime. 

For a composite N the defect of Fjv is positive, and it is usually greater 
than the dimension of affine Hadamard families stemming from Fj^, introduced 
in [15j. However, if the size of a matrix is a power of prime, N — , the defect 
and the dimension coincide. So, in this very case, an explicit construction 
of the defect-dimensional afhne family of unitary complex Hadamard matrices 
stemming from the Fourier matrix is complete. By 'complete' we mean that this 
solution cannot be embedded inside any orbit of inequivalent complex Hadamard 
matrices of a larger dimension. 

This work is organized as follows. In Section [2] the definition of the defect of 
a unitary matrix is provided. Several properties of the defect are investigated in 
Section [3l In Section [4] we present some applications of the defect analyzing the 
condition for a unitary matrix to be isolated and discussing the unistochasticity 
problem. Section [5] contains derivation of the formula for the defect of the 
Fourier matrix of an arbitrary size N and a discussion of its special cases. In 
Section[5]we provide two constructions of the defect-dimensional orbit of unitary 
complex Hadamard matrices stemming from Fm for N being a power of a prime 
number. The paper is concluded in Section [T] 

We use in the paper the notation Ao B ior the Hadamard product of two 
matrices, [A o B]^ j = AijBij, while EXP(A) denotes entrywise exponentiation 
of a matrix, [EXP(yl)]j^ = exp{Aij). Also, as functions of matrices are used, 
to avoid doubts about an order of variables, for example when writing Jacobi 
matrices, we introduce vec, vecj^, vecc notation for appropriate vector forms 
of each matrix. Such notations make it possible for us to treat manifolds of 
matrices and their tangent spaces as subsets of R*^ , identified with the set of all 
real fc x 1 column matrices, and avoid more abstract constructions. These and 
other symbols used are listed and explained in Appendix [XI 
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2 The defect of a unitary matrix 



2.1 Definition of the defect 

Let 'veC]ii{U) be a submanifold of R^^ representing the set U of all N x N 
unitary matrices (for the notation consult Appendix [X|) . Consider also the {N — 
1)^ dimensional minimal hyperplane containing bistochastic matrices vec(;B) C 
, and a map / : — > M.^ , effectively squaring the moduli of the 
entries of an x complex matrix U: 



/(vecR(C/)) = vec(B) where B,,, = |i7,jf . (2) 

. TC.2J 

vecji(;7) 



Next consider the tangent map i^/vec lu) ■ IR^^ — > , realized by the 



appropriate Jacobi matrix: 

^/vec^(c/) i^ecniV)) ^ (3) 



diag (vec(Re([/)) 



diag I vec(Im([/)) 



• vecB(y). 

(4) 

Consider also the tangent spaces, the space Tjjtl tangent to vecji(U) at 
veC]R(C/) for some unitary U & U, and the space TbB tangent to vec(i3) 
at vec(i3) ~ /(veC]R([/)), a bistochastic matrix. TuU here and further is 
understood as the nullspace of the Jacobi matrix of the map veC]R(M^) — > 
•vecT[i{W*W — I) calculated at veC]R(J7) (i.e. the kernel of the corresponding 
tangent map). TbB is the space of all vectors vec(G) with G being a real NxN 
matrix with sums of all entries in each row and coUumn equal to zero, irrespec- 
tively of a bistochastic B. It is clear that the image of TjjU under i'/vecjaCC/) 
must be contained in TbB, so its dimension is not greater than {N — 1)^. It is 
reduced, with respect to that value, by a number which will be called defect of 
U: 

Definition 2.1 The defect of an N x N unitary matrix U , denoted A{U), is 
the following integer number: 

AiU) = {N~\f- dim (i?/vec«(t/) (JuU)) . (5) 

It is obvious that d{U) — d \s equivalent to the fact that the dimension of 
the part of the nullspace of £'/veciR((7) contained in TulA is equal to 



dim (^nullR(I?/,3,^(^)) n TuU) = (6) 

dim {TuU) - dim (T /(veci,(c/))S) +d = 
N^-{N~lf + d = 2N~l + d. 

If d(C/) > then -vec-^iU) is also called a critical point of map / restricted 
to U. 
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2.2 Other characterizations of the defect 

The tangent space T(jU is equal to the set: 

I veC]R (£'[/) : E anti-hermitian| = (or ahernatively) (7) 
|veC]R([/F) : F anti-hermitian| 
and is spanned by all the independent vectors from the set: 

|veC]R(A(*'^'^?7) : 1 < « < j < iv} U |veC]R(S'^''^V) : I < i < j < (8) 
where 

r 1 for (fc,0-(*,j) , ^ r i for (fc,0 = («,j) 

4f = \ -1 for = = < i for (fc,0 = (j,0 (9) 

[ otherwise [ otherwise 

l<i < j < N 1 <i < j < N, 

as matrices and S'^''^) span the real space of anti-hermitian matrices. 

Since £>/.^,gj.^(yj(veC]R(S'^*''^/7)) = we consider only ordered pairs i < 

J, in construction of a matrix containing vectors spanning ^/vec]a((7) (Tt/^) 
as its columns. 

First, let us construct an N'^ x N{N — l)/2 complex matrix Mc such that 
it's a{i,j)-th column (see Appendix [XI for a{.,.)) is defined by: 

[^c]i:Ar2,„(,,,) =vecc(f/(^'^')), (10) 

where is an iV x complex matrix, with the i-th and j-th non-zero rows 

only, being negations of each other: 



Secondly, we form an N"^ x N{N — 1) real matrix M 



= Ui^V.N °Uj^l;N, (11) 

i,l:N 
J,1:N 



Re(A/c) Im(Mc) 



(12) 



M = 

which has that nice property: 

= [Re(Mc)]i^^._„(,,^.) = i?/vecH(c/) (vecK(A(-^");7)) , (13) 

^A:JV^^<^+a(.,) = [Im(^c)]i:JV^a(.,) = ^/vec^(C/) (veCR (S^^^'") (7)) . 

Hence spa.n-^{M) = D/yg^^j-j;-) (T[/W), and the defect of U can be calculated as 
d{U) = iN - i f - rank(M). (14) 
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Note also that 



dini(null]R(A/'^)) ^ N'^ - dim(span]R(M^)), (15) 

where 

dim(span]a(A/'^)) = dim(span]a(A/)) = (iV - 1)^ - d{U), (16) 

so 

A{U) = TV^ _ (27V- 1) -dim(span]R(M^)) 

= dim(null]R(M'^)) - (27V - 1). (17) 

The nullspace of is the solution to the real system 

M'^-vec(i?) =0 (18) 

with respect to a real N x N matrix variable R, which can be rewritten with 
the matrix Mc : 

• vec(i?) = 0, (19) 

or explicitly 

JV 

V l<i<j<N ^U,,kUJ,k{R^,k-RJ,k)^Q■ (20) 

k=l 

System (|20p is solved by the (2A^ — 1) dimensional real space spanned by matrices 
with only one row, or only one column, filled with I's, the other elements being 
zeros. If the real solution space of ([20| is not greater than that, then d([/) = 
according to the alternative definition (jl7p of the defect. 

The solution space of system (pHl) can also be expressed as 

|i? : \RoU = EU for some anti-Hermitian i?| = (or alternatively) (21) 
|i? : (ii? o U)U* is anti-Hermitian| , 

that is the set of those R, for which the direction veC]R(ii?o U) of the zero first 
order change of moduli of matrix U sitting in veC]R([/) belongs to the tangent 
space Tul^- 

Those special i?'s that solve ([20|) . give rise, through R ^ iRoU, to matrices 
i • diag(efe) ■ U, U ■ i ■ diag(efc), which satisfy the equality in the definition of 
the set in (|2T|) . If a matrix U has no zero entries, like in the case of unitary 
complex Hadamard matrices, then it spans a (2N — 1) dimensional real space, 
which can be represented in the vector form, 

sparij^ ^ |veC]R(i • diag(efe) ■ U) : k = l..N^ U |veC]R(;7 • i • diag(ei;)) : k = l..ivj 

(22) 
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This is due to the fact that for Hnear combinations we have this equivalence 
with the special i?'s, e^e-^, ee^ (for e see Appendix [X]) : 

N N 

^ afcVeC]R(i • diag(efc) ■ U) + ^ /3zveC]R(t/ • i • diag(ei)) 

k=l 1=1 

N N 
k=l 1=1 

if \Ui,j \ ^ for i,j S Also in this case, the vectors 

veC]R(i-diag(efc)-C/), k = 1..N and veC]R([/ • i • diag(e/)), 1 = 2. .N (24) 
span the space tangent at \'ec-^{U) to a (2A^ — 1) dimensional manifold: 

|vecR(diag(e'"S...,e'"~)-C/-diag(l,e'^=,...,e''3")) : ak,Pk&B^, 

(25) 

and if d{U) = d > then these vectors, together with additional independent 
vectors vi, . . . , Vd, form a basis for the space 

nullR(D/,,,^(y))nTc/Z^. (26) 

In general, vectors always belong to the above space, but they may span 
a space of dimension smaller than {2N — 1) (and not greater, through the it 
implication in for at = — /?/ = 1). Then also the manifold ([^5]) . obtained 
from U by the left and the right multiplication of U by unitary diagonal matrices, 
will have its dimension reduced. This is the subject of Lemma [3?6l in Section [3l 
In section l4?2l we are going to apply another characterization of the defect. 
New formulae and the ones already introduced, all of which will later be used 
when proving various properties of the defect, are summarized by the following 
lemma. 



= 

t (23) 

= 0, 



Lemma 2.2 The defect of an N x N unitary matrix U can be calculated as 



d{U) = dim(nullR(Af'^)) - {2N - 1) 

= (A^ - 1)^ - dim(span]R(M)) 

= dim(nullc(W^^)) - (2A - 1) 

= (A^- 1)2 - dim(spanc(W^)), 



where (with Mc of I110\) ) 



(27) 
(28) 
(29) 
(30) 



W 



Mr. -Mf 



(31) 
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Proof 

Only the formulas ((29l [30)1 need explanation. Note that: 

i; e nullc(VK^) =^ V, Re{v), Ini{v) enullciW'^), (32) 
r real e nullc(VK^) =^ r e null]R(M^), (33) 
renull]R(M^) r G nullc(W^^). (34) 

Let Ri, i — 1..N, denote matrices with the i-th row filled with I's, hav- 
ing O's elsewhere, and let Cj, j = 2..N, denote matrices with the j-th col- 
umn filled with I's, having O's elsewhere. Obviously, vec(i?i), vec(Cj) G 
null]R(M'^), nullc(M/^), and they are all independent. 

Let vectors vi, . . . , Vd G (D^ be such that the set of complex vectors 

|wi : Z = U |vec(i?,) : i = L.ivj U |vec(Cj) : j = 2..iv| (35) 

is contained in nullci (W^) and consists of independent vectors. In this reasoning 
the case when d = 0, that is when {ui, . . . , Vd} is empty, is included. 

Then one can choose real vectors ri, . . . , G {Re(u;), Im(w/) : I — l..d} 
such that the set of real vectors 

|n : / = U |vec(i?,) : i ^ L.ivj U |vec(Cj) : j = 2..iv| (36) 

is contained in nu.ll^{M'^) and consists of independent vectors. 
This choice is possible due to the following inclusion relation: 

spanc (^{vr- 1 = U |vec(i?,) : i ^ l..N^ U |vec(Cj) : j = 2..Ar|^ 

n (37) 
spaiic ^ |Re(ui), Im{vi) : I = l..ff| U |vec(i?j) : i l..iv| U |vec(Cj) : j = 2..iv|^ . 



On the other hand, if we asssume that all the vectors in the set ([36]) are 
independent and belong to null]R(M-^), then they form an independent set, as 
complex vectors, in null<c(VF"'"). 

Thus we have come to that: 

dim (nullK(M'^)) = dim (nullc (W^^)) . (38) 

■ 

To provide yet another characterization of the defect of U, used later in 
section 14.11 in the proof of Theorem 14.21 let us define a function g : — > 
■[]^Ar(Af-i) .^jjj g^j^gQ occur in section [6] in the proof of Theorem 16. 3|) : 

5(vec(i?))l = Re ( -i • V C/,,fc!7j- fce'(^-'=-^-'=M I < K j < N, 

(39) 

5(vec(i?))j ^Im(-i.f^C/,,fe!7,-fee'(^'.''-«-'=M 1 < * < j < iV. 
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Note that g(vec(i?)) = precisely corresponds to the condition that matrix 
U oEXP(ii?) is unitary. At this moment recall that f — f{U) can be interpreted 
as a function characterizing deviations of the moduli of an argument V with 
respect to the moduli of U while moving V along U. On the other hand, the 
function g measures deviation oi U o EXP(i_R) from unitarity along the set of 
matrices with constant moduli. 

The value of the linear map Djq : — > IR^(^^^), being the differential 
of g at 0, at vec(i?), is the vector 



N 



Z>?o(vec(i?)) 



— Re I ^ Ui^kUj^k {Ri,k 



R 



Kk=l 



N 



I^o(vec(i?)) 



-+a{i,j) 



= Im [J2U^,kUJ,k {R^,k~RJ,k) 



I <i < j < N, 
(40) 

l<i < j < N. 



The kernel of the differential DgQ corresponds to space of solutions of system 



(EOl): 



d(;7) = dim (nullK(I>7o)) - i^N - 1). 



(41) 



3 Properties of the defect 

Lemma 3.1 For any N x N unitary matrix U and permutation matrices Pr, Pc 

d{Pr -U-P,)^ d{U). (42) 

Proof 

Consider of and of ([H]), constructed for U , and consider also 
and M^^ constructed for ?7P, where P is a permutation matrix. Then, 
for / being the N x N identity matrix, 

= {I® P^)M^ =^ P^)M^ (43) 

which, using ((Til), results in d{UP) = d{U). 

Now, let P be given by Pi^-, = ecr[i)^ , cr being a permutation map. Then 
M^^ of pop for unitary PU is obtained from in the following steps: 

• negate and conjugate the a(i,j)-th column of if (J^^{i) > o'^^(j), for 
all 1 < i < j < iV 

• if cr~^(«) < shift the a(i, j)-th column of the result into 

the a(cr^^(i), (T^^(j))-th position within a new result, otherwise shift it 
into the a{a-^^{j), cr^^ (i))-th position, for all 1 < i < j < 

• left multiply the result by P (g) / 

which amounts to permuting and negating columns of to get the corre- 
sponding M^^. Thus again d{PU) = d{U). ■ 
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Lemma 3.2 For any N x N unitary matrix U and unitary diagonal matrices 

d{Dr-U ■D,)^d{U). (44) 

Proof 

Right multiplication of U by Dc brings no change to M^. Left multiplication 
by Dr stiffly rotates the chains of coefficients 

( U,^iUj,i, C/.,2l7,,2, U,,nUj,n ) (45) 

of system (PU]). so it does not change the space of its solutions nor the value 
of the defect (|17p . (This rotation is equivalent to right multiplication of each 
N"^ X 2 sub-matrix of M composed of the real and imaginary part of some 
column of Af(c, by a 2 X 2 real orthogonal matrix.) ■ 

Lemma 3.3 For any N x N unitary matrix U 

d(C/)=d(C/^) = d(C/*) = d(c7). (46) 

Proof 

Since = M^, for the Afc matrices of (fTO| constructed for U and U, we 
have that is obtained from by negating the right iV^ x N{N - l)/2 
sub-matrix of M^, which leads to d(C7) = d{U) by (fM]) . 

As for U'^ , we will show that the set (f2T|) . used in characterization of the 
defect, constructed either for U or U'^ , is a linear space of a fixed dimension. 
Let A denote the set of all iV x anti-hermitian matrices, R denotes a real 
matrix. There holds: 

{R : iRoU'^ = EU^ for some E e A} = 
{R: iR^ oU ^ {UE'^U*)U for some {UE^U*) e A} ^ 

{R: iRoU = EU for some E e A}'^ . (47) 

Thus the system (pn|) (equivalently system (IT51) ') solved either for U or for U'^ 
yields the solution space of the same dimension in both cases. By (fT7|) then 
d{U) = d{U^). ■ 

Let us recall the definition of an equivalence class in the set of unitary 
matrices [8l fT5]. 

Definition 3.4 Two N x N unitary matrices U and V are ~ equivalent if 

there exist permutation matrices Pr, Pc and unitary diagonal matrices Dr, Dc 
such that 

V = PrDr ■ U ■ DcPc- (48) 

Lemmas 13.11 and 13.21 implv that for any two ~ equivalent unitary matrices, 
y ~ [/, their defect is the same, d{V) = d{U). In particular, the defect is 
constant over the set of all unitary matrices obtained from U by left and right 
multiplying it by unitary diagonal matrices. This set is the image under vec^""^ 
of what we shall call the phasing manifold for U: 
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Definition 3.5 The phasing manifold for a unitary N x N matrix U is the 
set 

veC]R I Dr ■ U ■ Dc ) : Dr, Dc unitary diagonal > . (49) 



The phasing manifold for [/ is a difFerentiable manifold. Its dimension cannot 
be greater than 2N — 1, because any element of can be obtained with Dc 
having \Dc\i i = 1- More formally, we have 



Lemma 3.6 Let 
spanj^ 



^ |veC]R (i • diag(efe) • t/) : k = l..iv| U jvecR {u -i- diag(eO) : I = l-A^ 



(50) 

he spanned by all the vectors from the set of independent vectors (where p + r < 
2N - 1 ): 



veC]R [i ■ diag(ejj - Uy. k = l..p | U jvecR [U -i- diag(ej,)j : I = l..r ^ 

(51) 

Then the set 

•|veC]R (^Dr ■ U ■ : Dr, Dc unitary diagonal^ (52) 

is equal to a (p + r) dimensional differential manifold, given by the parametriza- 
tion: 

vecR l^diag (^EXP (lELi'/'fce,,) j • U • diag (^EXP (iELiV'ie,,)) j : <t>k,^P, 

(53) 

Proof 

First we show that sets (15^ and (|53p are equal, i.e. that each matrix Dr U Dc 
can be expressed with Dr, Dc satisfying: 

[Dr],^^ = l for (54) 
[Dc]^^j = l for j^{,n..jr}. (55) 

Let 

V = diag(e^'^\...,e''*")-[/-diag(e''^\...,e''''"), (56) 

V = diag(e''^V..,e''^")-C/-diag(e''^V..,e''^"), 



where 



i)i = (t)i + Si if ie{ii..ip}, tpj^tpj + Ej if j e {ji..jr}, 
(/)^ = if i ^ {ii-ip}, =0 if j i 



(57) 
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and where Si, ej are uniquely defined by the equation: 

5i-i - diag(ei) • C/ + ^ eyU-'i- diag(ej 

iG{n..ip} je{ji--ir} 



0i • i • diag(ei) • [/ + ^ Vj ■ • i ■ diag(ej 



(58) 



i(i/']V+te]v) 



Let 

V(i) = diag(e'("^i+*''i',...,e'("^"+**"))- L/ -diag (e'('''i+*'i), . . . , e' 

(59) 

where Si, ej are defined by ([58]) for i G {ii.Ap}, j £ {ji--jr}, and for the 
remaining i, j we define Si = —4>i, = 

Let also L and i? denote the left and right hand side of equation 
respectively. Then 



diag (^e'('^i+*'^i\ . . . , e'('^"+*'5")) • - i?) • diag (e' 



(i/ii+tei) i(i/'jv+t«jv) 
, . . . , o 



SO 

V = V{Q) = V{\) = V, (61) 

from which it generally follows that sets (|52p and ([55)1 are equal. 

The equality V = V can be verified entry by entry, using (j58p . without 
derivatives. Then one has to consider cases corresponding to possible answers 
to the question whether i and j from the index pair i,j of an entry belong or 
not to {ji--jr}, respectively. 

To show that (|53p is a (p + r) dimensional differential manifold, we need to 
check that the derivatives of the vector function in (j53p span a (p+r) dimensional 
tangent space. These derivatives are: 



vecR (^i • diag(e,,J • t/^ , (62) 



= veC]R • i • diag(ej,; 



T— vecR(...) 

o<Pk 

dip I 

and they form the p + r element set (j51l) which is assumed to consist of inde- 
pendent vectors. Thus (|53p is a p + r dimensional manifold around wec-^(U). 

Since left and right multiplication of U by unitary diagonal matrices does 
not disturb the linear independence of vectors in ([5T|) . and since the tangent 
space for any other veC]ft(_Dr ■ U ■ Dc) in ([55)1 is spanned by vectors of the form 
(|62|) . ([53]) is globally a. {p + r) dimensional manifold. ■ 

We will also provide a lower bound for the defect of a real orthogonal matrix, 
as well as a formula for the defect of a direct sum of unitary matrices. 
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Lemma 3.7 a) If Q is a real N x N orthogonal matrix, then 

> -^) . (63) 

b) If U is an N X N block diagonal unitary matrix, 

U = C/i®C/2®...®C/^, (64) 
with Ui of size Ni, Ur of size N^, then 

A{U) = (65) 

(r \ r r 

k=l ) k=\ fc=l 

where d[Uk) — if Nk = 1, according to the definition of the defect. 
Proof 

a) The Mci matrix of PT!]) constructed for Q, M^, is a real matrix. Then the 
corresponding M matrix of (fT2l) is equal to: 



mQ = 



Mc 



(66) 



and its rank is not greater then {N - l)N/2. Then by HH): 



^2 (iV-l)iV (iV-l)(iV-2) 



d(Q) > ^ = ^ 'j '-. (67) 

b) The M<c matrix ior U ~ Ui (B ■ ■ ■ (B Ur, , can be permuted to take 

the form: 

® M^^ e . . . ® M^- ® [0] (68) 
and consequently can be permuted to become: 

® M^=^ ® . . . ® M^" ® [O] , (69) 

where those summands M^'' for which Nk — 1 are 'empty' matrices, that is 
they do not enter the direct sum. 
Then by dUl): 



d{U) = (A^- 1)2 - rank(A/'^) = (70) 

r r 

{N - 1)2 - Y.{Nk -I f + Y. ((^fc - 1)' - rank(Af^'=)) = 



k=l k=l 



fc = l / /£=1 



where in the second expression we define rank(M'^'') = if M^'' is 'empty'. As 
d(f/fc) = if Nk — 1, the above formula is also valid in the case of presence of 
1x1 diagonal blocks in [/. ■ 



13 



4 Exemplary applications 

4.1 Isolated unitary matrices and continuous families of 
unitary matrices with a fixed pattern of the moduli 

Definition 4.1 A N x N unitary matrix is called isolated if there is a neigh- 
bourhood yy around veC]R([/) such that all unitaries V with the properties: 

• V has the same pattern of moduli as U, i.e. \Vi^j \ — \Ui^j\. 

• vec]R(t/) e yy. 

are those given by the intersection 

vec^^(yV) n ^Dr-U-Dc- Dr, Dc unitary diagonal^ . (71) 

A one way criterion for some U being isolated, associated witli calculation 
of the defect of U, is stated as follows: 

Theorem 4.2 // the defect d{U) — 0, then matrix U is isolated. 
Proof 

All the matrices with the same pattern of the moduli as in U are given by: 

t/oEXP(i-i?), vec{R)eM.^\ (72) 
and the unitarity condition for them can be expressed as 

N 

-i-^[/,,fcFj,fce'(^-'=-«-'=) =0, l<i<j<N. (73) 

k=l 

We can rewrite ((73)) with the use of function g defined in ((39)) as: 

5(vec(i?)) = 0. (74) 

From the characterization of the defect of U with the kernel of the differential 
of g at 0, see ((TO . we have that condition d{U) = imphes rank(Z3gQ) = 

— {2N — 1). Then one can choose a subsystem of system ((71)) . consisting of 
N'^ - I2N - 1) equations 

g(vec(i?)) = (75) 

with the full rank 

dim (i:§o(R^')) ^ - {2N (76) 

System ()75l) thus defines a {2N — 1) dimensional manifold around 0. 
This must be a (27V — 1) dimensional space: 

< vec ^afc(efc 
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If veC]R(C7 o EXP(ii?)) is in W, a small neighbourhood of veC]ft(J7), it can 
be expressed with vec(i?) in a certain neighbourhood of 0. (The latter neigh- 
bourhood can be made sufficiently small by decreasing the size of W, for the 
purpose of the next argument.) 

If C/oEXP(ii?) is unitary, then vec(i?) in this neighborhood of must satisfy 
system dTJ), hence system so it must belong to ([771). Thus U o EXP(ii?) 
must be of the form: 

diag(e'"\ . . . , e'"") • U ■ diag(l, e'/^' , e'""), (78) 

that is it belongs to the phasing manifold for U (Definition 13. 5p . 
■ 

In general, the defect of U allows us to calculate an upper bound for the 
dimension of a differential manifold J-' , stemming from vec]]^([/), generated by 
unitary matrices with the same pattern of the moduli as in [/, if exists: 

r C |vecR(T/) : V^Uand {\V,^,\ = for i,j G {1..7V})| . (79) 

Such manifolds exist, the phasing manifold (Definition 13. 5|) being a trivial ex- 
ample. 

What is even more important for us, we will consider dephased manifolds of 
this kind. By a dephased manifold we mean a manifold J- with the property 
described in this definition: 

Definition 4.3 A manifold (set) T , consisting of vector forms ■vecji{V) of 
unitary matrices V with the moduli of their entries fixed at some nonnegative 
values, is called a dephased manifold (set) if the condition holds: 

( vecuiV) and Dr ■ V ■ Dc ^ V ^ =^ veC]R(D^ ■ V ■ Dc) i T, 

(80) 

for any unitary diagonal matrices Dr, Dc- 

The importance of this subclass of manifolds comes from our interest in 
determining all ~-inequivalent (see Definition 13. 4p unitary matrices with the 
same pattern of the moduli, in particular unitary complex Hadamard matrices. 
This question is connected to the unistochasticity problem of Section 14.31 And 
the remark below explains this importance more precisely. 

Remark 4.4 Let veC]R([/) belong to such a dephased manifold T , as described 
above. The number of different permuted versions of U : Pr ■ U ■ Pc is finite, so 
finite is the number of their images Dj-Pr ■ U ■ PqDc ( obtained with the use of 
unitary diagonal matrices Dr, Dc) whose vector forms sit in T . This is because 
there can be at most one image for each Pj-UPc in veCjj^^(jF). 

We conclude that there are finitely many vector forms of unitary matrices 
c^-equivalent to U in T , and that veC]R(C/) has a neighbourhood in T in which 
there are no vector forms of matrices "r^i- equivalent to U. 
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Moreover, there are infinitely many points in this neighbourhood, represent- 
ing pairwise "r^i-inequivalent unitary matrices, forming a sequence converging to 
veC]R(J7). 

We need the notion of a dephased matrix: 
Definition 4.5 Let U be an N x N unitary matrix such that the linear space 



spanj^ 



jvecM (i • diag(efc) • (j) : ke {l..N}^ U jvecR (u-i- diag(eO) : I G {l..iV} 



(81) 

is spanned by (p + r) < 2N — 1 independent vectors from a spanning set; 



S = jvecR (^i • diag(ejj • C/j , . . . , vecB (^i • diag(ejj • [/) , (82) 
vecK ([/ • i • diag(ejj) , . . . , vecR [U ■ i ■ diag(ejj_ 



Let X be a {p + r) element set of index pairs, 2 C {1..-/V} x {1..N}, called a 
pattern set onwards, associated with U and the spanning set S in such a way 
that 



• vec (^(ci^e^) o F^, .... vec (^{ci^e'^) o , 
vec ^(eejj o , .... vec ^(eej^) o 

are independent vectors, where F — 'filtering matrix'. 

Then an N x N unitary matrix V , with the same pattern of the moduli 
as in U , is called dephased with respect to U , according to the pattern set X 
associated with the spanning set S, if 

^i.] = Ui^j for any {i,j) G I. (83) 

We use the notions introduced above in this lemma: 

Lemma 4.6 Let V be dephased with respect to U , according to a pattern set X 
associated with a spanning set S. 

If DrVDc ^ V, then DrVDc is not dephased (in the same manner), for any 
unitary diagonal matrices Dr, Dc- 

Proof 

Using the procedure appHed in the proof of Lemma [3. 6( one can find D'^, D'^ 
such that D',.VD[. — DrVDc, and (where ik, ji characterize S, as in Definition 
EM- 

[D;],, = 1 for t(^{i,,...,ip}, (84) 
[^c]jj=l for J ^ {ji, ■•■,>}• 
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If D'^VD'^ V, some of the remaining diagonal entries of D'^.: [D'j]^^ = 
and of D^: [D'^^^ — e"^^i must differ from 1. Now assume that D'^VD'^ is also 
dephased with respect to J7, according to the pattern set T associated with the 
spanning set S. Then, for F = j)£X ^i^J ■ 



p 



Fo(D;ra^)= F o EXP |^i|^^^0,,e.,e^ + 5^^,,eej;jj o V 
EXp|i(^0,, ((e.,e^)oF)+^7/^„((eej;)oF)) o (U o F) = U o F, 



\k=l 1=1 



where the last equality is the consequence of the assumption that D^VD'^ is also 
dephased. 

Since Uij ^ for G I, the respective phases must be equal to zero: 

p r 

J2 0.. ((e..e^) of)+Y. («) °f)=0 (86) 
fc=i 1=1 

and, as the vector forms of matrices standing in combination (|86p are indepen- 
dent (the property of the pattern set I, according to which D'^VD'^ is dephased), 
all 4>i^, ifjji are equal to zero, which contradicts that D'^VD'^ y^V.U 

We will further consider manifolds (stemming from wec-^iU)) of vector forms 
of matrices V dephased with respect to ?7 in a chosen way. The above lemma 
implies that such manifolds are dephased in the sense of Definition [ 



Theorem 4.7 Let U be an N x N unitary matrix and let J- be a differential 
manifold in stemming from vec-^{U), generated, through V •vec-^{V), 

purely by unitary matrices V with the same pattern of the moduli as in U , 
and dephased with respect to U according to a pattern set X associated with a 
spanning set S. 
Then 

dimJ^ = dim^TyJ") < h{U) (87) 

where 

def 

TjjJ- = Tvecjiiiu)^ space tangent to T at vec-R{U), 
h{U) = d{U) + {2N - 1) - ttof/ - tl5, where 
'ioU the number of zero entries in U, 

jJiS the number of elements of the spanning set S, equal to p + r < 2N — 1, 
where p, r bear the same meaning as in Definition\4.5\ 
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Proof 

Let V G T[/JF, that is ii = 7'(0) for some smooth curve 7(i) C J- such that 
7(0) = veC]R([/). Since vec^^(7) CU, v € TuU i.e. it satisfies 

V — veC]R(i? • U) for some anti-hermitian E. (88) 

Since the moduh of the entries of a matrix do not change over vec^{'-f{t)), 
V e nullji{Df^^^_^(^jjj) of ([S]), and in particular zero entries stay intact, so v 
satisfies also: 

t; = veC]R(i_R o [/) for some real matrix R. (89) 

Thus V belongs to a space parametrized by the solution space of (^0]) (or equiv- 
alently (fT8|) ). namely: 

V e V ^ |veC]R(ii?o [/) : vec{R)eTzj, (90) 

where 

TZ = |vec(i?) : iRoU = EU for some anti-hermitian E^ . (91) 

Let i C {l..iV} X {1..N} be such that [i,]) G X ^ ?7,,j = 0. Because of 
potential zeros in U, we can reduce the parametrizing space TZ of (j9ip : 

P = |veC]R(ii?o [/) : vec(i?) e 7^'| , (92) 

where 

7^' = 7^n |vec(i?) : V(z,j) e i = o| , (93) 

and since 

^ I vec (^a • e,ej) : aeRl © 7^', (94) 

we obtain a bound for the dimension of T> of ((90|) or ([92]) , using the characteri- 
zation (fT7|) of the defect of [/, stated also by Lemma [2?2] : 

dim(X>) < dim(7^') = dim(7^) - jJJ (95) 
= d(;7) + (27V - 1) - 'ioU, 

where 7^ = null]R(M^) with M of (HH). 
Further, for 'filtering matrices' 

(»,i)ex 

G = ee^- ^ e,ej, (97) 
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and for all the matrices (see the description of a spanning set in Definition 14. 5p 

i(e,,e^)o;7, k = (98) 

i{eel)oU, I = l..r, (99) 

in vecj;^^(5), vectors 

vecR (i(e,,e^) o Go [/^ , k = (100) 

vecR ( i(eep ° G o [/ ) , I = l..r, 



are still independent. 

As the considered manifold J- is composed of veC]R(y) with V dephased with 
respect to C/, that is with non-zero entries Vij , for (i, j) G I, fixed, a non-zero 
V £ TuJ^ must not belong to a (p + r)-dimensional subspace of T) defined with 
the use of basis vectors (llOOp by (we parametrize V with TV as in ([5^ , hence 
we use G in the formula below): 



V = <jvecKK^afe-i(e,,e^)oGo[/ + ^/3,.i(eej;)oGo;7 : afe, ^gR 

(101)' 

If V were in I?' , that is if it were a combination like that in (jlOip , then the 
dephasing condition would force for this tangent vector that 

(p ^ \ 

^afc • (e,,e^)oF + ^A • (eej;) o F o({/oF) (102) 
k=l 1=1 / 

implying ak =0, f3i — 0, because vector forms of matrices standing in the last 
combination are independent, being a requirement for the proper choice of a 
pattern set T in Definition 14.51 

Tf/JF is thus bound to be contained in some space T>" such that V — V (BT)" . 
The dimension of V" reads, using (PS]): 



dim(X'") = dim(X') - dim(2:»') (103) 
= dim(X') -{p + r) (104) 
< d(?7) + (2iV - 1) - Hot/ - tt^, 

which completes the proof. 

Note that if is a parametrization of J- around veC]R([/), T having the 

properties stated in Theorem 14.71 then 



= vecR 



V 



(105) 
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parametrizes a. {p + r) + dim dimensional manifold around veC]R(C/). The 
additional independent vectors (|100[) spanning (together with a basis of Tjj^) 
the space Tu^' can obtained by differentiating (jlOSp with respect to (j)k, ipi- 
That is to say, TuT' = X>' ® Tu^- 
U 

Note that the bound h{U) defined in Theorem 14.71 is independent of the 
choice of a spanning set for U. Also, it is natural to suppose that for U having 
a block diagonal structure U = Ui® ■ ■ -(BUr this bound could be the sum of the 
bounds calculated for its diagonal components. This rule of a total bound, not 
necessarily our h(U), being the sum of some bounds for Up, applies to a very 
special construction of a manifold ^ in Theorem 14.71 in which the direct sum 
of matrix forms of respective parametrized dephased manifolds constructed for 
Ui, Ur is taken to get the matrix form of J-: 

vecj^^j^) = vecj^i(j^i) ® . . . vec^^J^r), (106) 

and it is because the dimensions of the component manifolds add up to the 
dimension of J-. 

In fact, this rule holds for the quantity h{U) defined in theorem 14.71 

Lemma 4.8 Let U — Ui (S U2 (B ■ ■ ■ (B Ur be a block diagonal unitary matrix of 
size N , where Np denotes the size of Up. Then 

b(C/) =b([/i) + b(C/2) + ... + b(C/,) (107) 

Proof 

Let Sp be a spanning set for Up. Let us construct a spanning set S for U using 
the rules 

veC]R (i ■ diag(efe) • [/p^ e 5p =^ vgcr • diag (e^p-i^ N^+k) ' ^ ^' 

(108) 

vecR (Up ■ i • diag(e/)^ £ Sp =^ vgcr ^C/ • i • diag (e^p-i^ N^+i) ^ ^ 

and let every element of S be put into it in this way. Thus S is properly 
constructed and it is clear that every spanning set for U must be created in this 
manner. 

Though it is not a part of the proof, let us mention that a pattern set X 
associated with the set S must have all its elements put into it using the rule: 




{i,j)eip =^ { y^Nm + I, }^N,n + j \ e I, (109) 



where Xp's are some pattern sets associated with the sets Sp used in the con- 
struction of S. 
Therefore, 

tt5 = + tt52 + . . . + (110) 
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where again '^Sp stands for the number of elements in Sp. 

Using the above equality as well as formula ([65]) in Lemma [3.71 we find 
that: 

h{U) - (111) 
d{U) + (27V -1) - hU - tt5 



(N-lf-Y,{Np-lf\ + Y.^{Up) + 

(r r \ r 

^|^d(C/p) + {2Np-l) - foC/p - B5pj 

r r r 

+ {N^lf-Y,(Np-lf + r-1 - ^2 + ^A^p2 = Eb(C/p) 
p— 1 p— 1 p— 1 



4.2 Relation to results of Nicoara 

In a paper |24| on commuting squares of von Neumann algebras Nicoara intro- 
duced the 'span condition' for such a square to be isolated. Consider the simple 
case of a commuting square of orthogonal maximal abelian *-subalgebras of the 
algebra of complex N x N matrices: 

V C MNi<C) 

U U , (112) 

C • / c u*vu 

where (D • / is the algebra of all x iV scalar matrices, V the algebra of all x iV 
diagonal matrices, U a unitary complex Hadamard matrix, i.e. iC^ij P = 1/A'^. 
Any abelian *-subalgebra, as closed with respect to the hermitian transposition 
(...)*, is unitarily diagonalizable, and if it is maximal, then it is diagonalizable 
into v. The property that a commuting square (|112p is isolated is equivalent to 
U being isolated in accordance with Definition 14.11 The span condition in this 
case reads: 

Lemma 4.9 A unitary complex Hadamard matrix U is isolated if 

dim([X>, U*VU]) = (N-lf, (113) 

where 

[V, U*VU] =^ spanc {vecc (Di • U*D2U - U*D2U ■ Di) : Di, D2 e pj 

(114) 
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Condition (|113p is equivalent to 



dim (spanc Qvecc (s^^^^)) : i,j € {l-.A^lj^ 



(115) 

where is an x matrix filled all with O's except for the i-th row and 

the i-th column: 



B 



i,l:N 



B 



1:7V/, 



= - B 



(116) 



as for Di = diag(ai, . . . , ofAr), D2 = diag(/3i, . . . , Pn) 
Di-U*D2U - U*D2U-Di = 



i,ie{i..JV} 



(117) 



We will show that the sufhcient condition pi3p is equivalent to our condi- 
tion d{U) = for {/ being isolated. That is, using also Lemma [331 that the 
equivalence holds: 



d{U) = ^ d{U*) = (fTT5)l . 
To show this, take U* and form matrix W of Lemma [2^ for U*: 



W 



u* 



-M. 



(118) 



(119) 



then concatenate it horizontally with an N"^ x N matrix filled only with O's, and 
reorder the columns of the resulting matrix to obtain a square matrix B having 
the property that it's k-ih. iV^ x N sub-matrix, k = 1..N , is equal to: 



B 



l:m,(k-l)N+l:kN 



vec(c 



(120) 



vecc 



where C/(*'J) is defined by pT]) for i < j, and we additionally define: 



[/(^■^*) = -C/(»J) for j >i. 
Then the rows of B correspond to matrices B^*^^) : 



_g(*j') 



vec. 



B 



(121) 



(122) 
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and thus, also by Lemma [^T^ 




dim ^spariji (i?-'") j = dim ^span,^, (i?) j = 

dim (sparic (W^^*)) = [N ^ if - d{U*) = 

(iV- 1)2 -d(C/). (123) 

From the above (|118p immediately follows. We can formulate yet another 
characterization of the defect: 



d{U) ^ (iV-l)2 - 




(124) 

with described by ifTTB)) . 



4.3 The unistochasticity problem 

Related to some applications in physics is the unistochasticity problem, that 
is the problem of extracting full information about a unitary matrix from the 
moduli of its entries only. 

Definition 4.10 An N x N bistochastic matrix B is caZZerf unistochastic (or- 

thostochastic^ if there exists an NxN unitary (real orthogonal) matrix U such 
that Vi,j e {l-N} B,,j = 

In other words, B is unistochastic if vec(_B) = /(veC]R(C/)) for some unitary 
U, having / defined by ([2]). In physical applications, «,j-th entries of B cor- 
respond to probabilities of obtaining the i-th possible result of an experiment, 
being one of some chosen N 'orthogonal' states of a measured quantum sys- 
tem, given the j-th initial state was prepared. In this framework U, a unitary 
preimage of B, describes possible evolution of the state of the measured system 
between the moments of preparation and measurement of the state. 

A more detailed question concerning the unistochasticity issue is the follow- 
ing: does there exist a unistochastic ball around the flat matrix J^r, [JatJ^^- = 
1/N, within the Birkhoff's polytope, the set of all bistochastic matrices? Note 
that Jpf is unistochastic for every N, since the Fourier matrix Fjv of (|129p is 
its unitary preimage. A partial answer to the posed question, which uses the 
notion of the defect, is provided by the lemma: 

Theorem 4.11 Let U be a unitary complex Hadamard matrix, i.e \Uij\ = 
l/\fN, thus being a unitary preimage of the fiat bistochastic matrix, veC]ft([/) S 
/-I (vec(Jjv)). where [Jn],^, = 1/iV. 

If d{U) — then there exists a unistochastic ball around Jjv in the set of all 
bistochastic matrices. 
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Proof 

Consider the maps (differential symbols also denote their matrix representation 



• u : W C R^' — > R^^^ parametrizing the unitary manifold vecjulU) 
around veC]R([/), W open , such that u{0 E W) = veci^{U). Then 
-Duo(R^ ) = TjjU and columns of Duq form a basis of Tjj^ 



• / : R2^ — > R^' defined earlier in ^vec-^ (^/ (vecK(C/)) 
|J7ij P, a map squaring the moduli of the entries of a complex matrix 

• TO : R^' — > R(^-i)', m(vec(B)) = vec {Bi.,n-is:N-i) , where the 
second vec is over {N — 1) x {N — 1) matrices, m provides a one to 
one map between bistochastic N x N matrices and {N — 1) x {N — 1) 

matrices with non-negative entries, m (vec(Jjv)) = vec ^-^^^ J^r-i^ , 

i>«vec(,/„) (Tvec(J„)S) = R(^-1)' 

Since d{U) — 0, from the definition of the defect Df^^^_^(jj-^ {T^ulA) = 
Tvec(jjv)'S7 that is an N"^ x N"^ matrix Df^^^^^jj^ ■ Duq contains a basis for 
Tvec(jjv)^: say at ji, j2, • ■ ■ , j(Ar_i)2-th column positions. 

Consider the map u : R^^^^'" — > R^^ , being map u restricted to its 
ji-th, j(7v-i)2-th variables, the other variables being set to 0. Then of course 
columns of ^/vecii(t/) ' form the above basis of Tvec(Jiv)'Si ^-iid columns of 
the {N — 1) X {N — 1) matrix i^ivec(jjv) ' -D/vec]R((7) ' must form a basis for 
^ ^ Q ^]-^jg matrix is non-singular. 

Thus the differentiable map m{f{u)) : R(^~^) — > R(^~i) satisfies the 
Inverse Function Theorem. This means that each point v in an open set V C 
around vec(^^^^ J^r-i) has its preimage w in an open set VV C R^''^"-^) 
containing 0. 

Consider a 'pseudo-inverse' of to: n, such that: 



e S , (125) 



where the second vec is over {N — 1) x {N — 1) matrices, and the iV-th row 
and 7V-th column of the matrix in brackets on the right hand side is completed 
to form a bistochastic matrix. Note that n{m) = id over vec(;8), and of course 
m{n) = id. 

The stated above property of m{f{u)) can now be rephrased as: 
Any point n{v) in the set n(V) open in vec(;B) around vec( J^r), correspond- 
ing to a bistochastic matrix vec~^(n(?;)), has its preimage u[w) £ u{W) C 

-1 

R 

V = 'm{f{u{w))) 

t (126) 
n{v) = f{u{w)). 



vecjn{V(), corresponding to a unitary matrix veCjR^(u(w)): 
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In section [5] we show that the defect of the Fourier matrix Fn is equal to zero 
only for N prime. Therefore it is tempting to suppose that a unistochastic ball 
around Jn may not exist for composite N. This is indeed true for A'^ = 4, as 
there exists a ray, stemming from J4 , of bistochastic matrices with the property 
that they have not unitary preimages [1]: 



J4 + t 



t e 



1 

-9'0 



(127) 



However, for = 6 there exists a unistochastic ball around Jq. This is because 



called 'spectral matrix' 


Sq : 








" 1 


1 


1 


1 


1 


1 




1 


1 




LU 






1 


1 


LO 


1 






LO 




1 


LO 




1 


UJ 


LO-' 




1 






LU 


1 


LO 




1 




LO 




UJ 


1 



where 



27r 

exp 1 1 • Y 



(128) 

found independently by Tao [32] and by Moorhouse [31] (denoted by s'^q^ in our 
catalogue [15]), has the defect equal to zero, so Theorem 14 . 1 1 1 can be apphed. 
Similar examples for TV = 9 and = 10 can be found in [27], see matrices iJg 
and BNiQ there (in 15J they are denoted by Ng^^ and iV^o'')- Thus we also have 
unistochastic balls around Jg and Jiq. 



5 The defect of a Fourier matrix 

In this section we will use system ^U\i to obtain the value of defect of the N x N 
unitary Fourier matrix F^r, 

[F^] =^/'^(.^-^^U-^) i,je{l,2,...,7V}. (129) 

This value, as well as the defect of any unitary complex Hadamard matrix H 
{\Hij\ = 1/^/N), is interesting from the point of view of the unistochasticity 
issue, discussed in the previous subsection. If the defect of such a matrix equals 
zero then there exists a unistochastic ball around the flat matrix Jjv {[JN]ij = 
1/N) in the set of all bistochastic matrices, see Theorem l4.11l Furthermore, the 
result (i(Fjv) — implies that the Fourier matrix is isolated, see Theorem 14.21 
On the other hand, any positive defect d of a given unitary complex Hadamard 
matrix H (of which F^ is an example) gives the upper bound for the dimension 
of a smooth orbit of complex Hadamard matrices, dephased with respect to H, 
stemming from H. This is stated by Theorem 14.71 
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A similar approach, to the one presented below in calculation of the defect, 
can be used to calculate the defect of any Kronecker product of unitary Fourier 
matrices. In fact, one needs to calculate the defect only for representatives of 
permutation equivalence classes of such products, see For instance, Fq is 
permutation equivalent to ^2 'H' so Lemma |3 . 1 1 implies that their defects are 
equal. On the other hand, Fi®F2®F2 and F^^F^ are permutation inequivalent, 
even if we pre-multiply both products by unitary diagonal matrices |26| . Thus 
Lemmas 13.11 and 13.21 cannot be used and these defects need not to be equal. 



5.1 Statement of the main result 

Before we prove a formula for the defect of the Fourier matrix of size N , we 
need the definition of a parameter cycle matrix, in which the notion of least 
common multiple (1cm) is used. 

Definition 5.1 A parameter cycle matrix fPCMj of size N is any complex 
N X N matrix P built using these rules (where P^'^ designates parameters in 
matrix P in a way different from ordinary indexing of rows and columns; we 
call X the step index and y the cycle index): 

• The first column of P is filled with N arbitrary real numbers, P*^'", . . . , p'^^^-^ ^ 
running from the top to the bottom. 



For the step index j G {2, . . . , } if N is odd, or for j £ {2, . . . , } if 
N is even, the j-th and {N — j + 2)-th column of P are filled in such a 
way that 

pi-^^^-^ = (130) 



Pr 



-l.k-l — 



Pk, N-j+2 - -P(fe+(j-l))mod AT, Ar-j+2 - ••■ - -P(fc+( ic».(iv.j-i) mod N, N~j+2 ' 

where 

N 

fc = 1, 2, ■ .■■ ■ ^. (131) 

designates the (fc — l)-th (lcm.(N,j — 1)) /(j — 1) element 'cycle', and 
pj-i,k-i gj^g arbitrary complex parameters of P. 

If N is even, then the {N/2 + l)-th column is filled according to the pattern: 
= n-,f+i = ^fc+f,f+i /or fc = l, 2, ^ , 

(132) 

where P~''^~^ are arbitrary real parameters. 



26 



As an example we provide a parameter cycle matrix of order 6, 

pO,0 



po, 



pO,: 



p0,3 



pOA 



p0,5 



p 



1,0 



pl,0 



3l,0 



p 



1,0 



p 



1,0 



p 



1,0 



p2,0 



2,0 



'2,1 



p2,0 



p2,l 



P 



3,0 



p3. 



P 



3,2 



p3,0 



P 



3,1 



p3,; 



p2,0 



p2,l 



p2,0 



p2,l 



p2,0 



p2,; 



pl,0 



pl,0 



pl,0 



pl,0 



pi 



pl,0 



(133) 



The notion of the parameter cycle matrices allows us to obtain concrete 
results on the defect of the Fourier matrix Pjv of size N . It can be expressed by 
a sum of greatest common divisors (gcd). 

Theorem 5.2 For N being a natural number 

1 - iV + 2 X;iX gcd(A^, for N odd, 



d(Pjv) 



1 



N 



2 Y,i=i gcd(A^, /) for N even. 



Proof 

We rewrite system (|20|) for P/y, denoted further as P: 



N 



VI < i < i < iV P^,kF,^k {R^M - R, 



fe=l 



as 



N 



N 



Ri,kFj~i+l,k — Rj,kFj-i+l,k , 



k=l 

and there also generally holds that 

TV N 



k=l 



N 



R'i,kFj-i+i,k = ^ Pj,fcPAr_(j_i)+i^fc — ^ P,;,fcPj 
fe=l fc=l fe=l 

We introduce a complex N x N matrix P such that: 



P = RF* 



N-{j-i) + lM 



R = PF 



(134) 



(135) 



(136) 



(137) 



Then statements (|135p and (|136p can be expressed in terms the elements of 
matrix P as: 



P 



(138) 



= P 



i,Af-0-i) + l 
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Rules (|138p as well as the requirement of matrix R being real force matrix 
P to be a parameter cycle matrix of Definition 15. 1[ and the solution space of 
(|134p is fully parametrized by the formula R ~ PF, where P is any such PCM 
matrix. 

The total number of real parameters in P, parametrizing the solution space 
of (|134p . reduced by {2N — 1) to become the defect of Fat, reads: 

• N odd: 



2Eh^-l - 2^(gcd(7V,0-l) 



N 

1=1 \ I / 1=1 



• N even: 



2EYi^4) - 2£7gcd(iV,0 4 
That is: 

N-l 

N odd: d{FN) = l-N + 2Y,iJi gcd{N,l) (139) 
A^evem diF^) = 1 - f + 2 gcd(iV, (140) 

■ 

Alternative formulas, for the defect of F/v can be useful. 

Theorem 5.3 For any natural N > 2 with the factorization into prime num- 
bers: 

n 

^ = n Pi^' Pl>P2> ■■■>Pn (141) 

there holds 
a) 

N-l 

d(Piv)= E (gcd(iV,0-l) , (142) 



1=1 



diFN) = n [ J[{1 + A:, - ^) - 2 I + 1 . (143) 



The proof is provided in Appendix [ 
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5.2 Some special cases 

Since the explicit formula (|143p is not very transparent the defects of Fourier 
matrices for small dimensionalities are collected in table 1. 



Table 1: Defect for the Fourier matrix Fj\j of size N. 



N 


1 


2 


3 


4 


5 


6 


7 


8 


9 


10 


11 


12 


13 


14 


15 


16 













1 





4 





5 


4 


8 





17 





12 


16 


17 


N 


17 


18 


19 


20 


21 


22 


23 


24 


25 


26 


27 


28 


29 


30 


31 


32 







28 





33 


24 


20 





53 


16 


24 


28 


49 





76 
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Let us now discuss some special cases of the formula for the defect of the 
Fourier matrix Fpf. 

i) . A'^ is prime. 

li N = p then n = 1, fci = 1, so the right hand side of equation (|143p reads 
p{2 — 1/p — 2) + 1 and provides the result d(Fp) = as advertised. Hence the 
Fourier matrix of a prime dimension is isolated. 

ii) . iV is a product of two distinct primes. 

li N ^pq then n = 2, fci fc2 = 1 so (IT43)) reads 
pq [(2 - l/p)(2 - l/q) - 2] + 1, which gives: 

d(^;,,) = 2{p-l){q-l) (144) 

It is worth to emphasize that the upper bound h{Fpq) (see equation ([ST)) ) for the 
dimension of an orbit of dephased unitary complex Hadamard matrices stem- 
ming from Fpq implied by this formula is exactly twice the dimension D of the or- 
bits actually constructed in [8l[T2l[T5] for a product of primes, D = {p— l){q— 1). 
The problem of describing the entire (possibly existing) manifold of dephased 
unitary complex Hadamard matrices stemming from the Fourier matrix Fpq is 
open even in the simplest case A'^ = 2 • 3 = 6 '15], but a recent discovery of a 
new 'non-affine' (according to the proper definition in our catalogue [15j ) N = 6 
orbit of unitary complex Hadamard matrices [37j , and some further results seem 
to suggest that in this case a full 4 dimensional orbit does exist |30) . 

iii) . A'^ is a product of three distinct primes. 

If iV = pqr then n — 3, ki = k2 = ks = 1 and eq. (jl43p amounts to: 

d{Fpqr) = 2[3pqr - 2{pq + pr + qr) + {p + q + r)] . (145) 

iv) . iV is a power of two. If = 2*^ then p = 2, n = 1 and ki — k, so (|143l) 
leads to: 

d{F2k) = 2'=-i(fc-2) + l . (146) 
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v). A'' is a power of a prime. 

If N = p'^ then n = 1 and ki — k, so (|143p takes the form of: 



d(Fp.) = [{p-l)k - p] + 1 . (147) 

Interestingly, in this very case the defect is equal to the dimension of the known 
smooth orbits of dephased unitary complex Hadamard matrices stemming from 
Fpk , featured in Section [6] This shows that these solutions are complete in the 
sense that they are not contained in smooth orbits (of the respective type) of a 
higher dimension. 

6 Orbits of the maximal dimension stemming 
from Fourier matrices of a prime power size 

In this section we present examples of N x N unitary matrices U with no zero 
entries, for which there exist d(J7)-dimensional smooth families (manifolds) 
generated, through V veC]R(l/), by unitary matrices V with the same pattern 
of moduli as in U, and dephased with respect to U. 

As U has no zero entries, a spanning set S for U (see Definition 14. 5p will 
always have p + r ^ 2N — 1 independent vectors as its elements. So, according 
to Theorem 14. 7[ a manifold of the type described above will have its dimension 
bounded just by d{U). 

We will consider Fourier matrices Fpk , of the size being the fc-th natural 
power of a prime number p, as examples for which this bound is saturated. To 
make the notion of being dephased with respect to Fpk precise, as Definition [43] 
requires, and also for practical reasons, we arbitrarily choose the spannig set for 
Fpk to be: 

5f^, = |vecR (i • diag(e^) • Fpk) : r e {\..p^}^ U |vecK [Fpk ■ i • diag(ec)) : c e {2..p^} 

(148) 

and the pattern set to be: 

Xf^^, ={(1,1), (2,1), (/,1)} U {(1,2), (1,3), (1,/)}. (149) 

In other words, Y is dephased with respect to Fpk , according to Xp ^ associated 
with Sp 1^ , if the entries in the first row and column of V are equal to the 

corresponding entries in Fpk, i.e. they are all equal to l/-\/p*^. Of course V is 
assumed to be a unitary complex Hadamard matrix, that is VV* = I, \Vij \ = 

for *ii = l--P*'- 

To construct a (i(Fpk )-dimensional manifold, generated by dephased unitary 
complex Hadamard matrices, stemming from veC]R(_Fpfe), we have to take a 
subspace of the space of all parameter cycle matrices (PCM matrices) P of size 
p'^, introduced in Definition 15.11 Because of the dephasing condition, and this 
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will be made clear in the proof of the theorem below, we have to impose on 
P additional constraints. We have to set all p'' real parameters of P sitting in 
the first row to zero, and each of the remaining (p*^ — 1) (out of the total of 
2p*'' — 1 to be fixed) real parameters sitting in the first column to minus the sum 
of the remaining complex parameters sitting in the same row as the parameter 
(in the 1-st column) being set. This leaves d{Fpk) real parameters free. Then 
the second column of P as well as each j-th column with {j — 1) not divided 
by p are filled all with zeros. Using these constraints as well as the alternative 
indexing of parameters in P (see Definition lS.ip . we state that: 



Theorem 6.1 The d(Fpk) -parameter family 



vecR {Fpk o EXP(iPi^pfc)) : P is PCM, and 



P-'' = for < ^ ( k ^ 

\ ^f p = 2 



(150) 

is a differentiable manifold stemming from veC]a(i^pfc), and is generated, through 
V veC]R(T/), by unitary complex Hadamard matrices V dephased with respect 
to Fpk according to Xp ^ associated with Sp ^ ■ 

Proof 

Let P satisfy the constraints formulated in (|150p . 

The first row of PFpk is filled with O's, as Pi^- = 0. In the first column the 
entries satisfy, due to the constraints imposed on P: 

1 1 f \ 

[pFp^].+,,, = ^-E^^+i.^- - k"^^+E^^+i.^- =0- (151) 



VP'' j = l \ j=2 

Thus PFpk , which is real thanks to the PCM structure of P, has its first row 
and column filled with O's, so Fpk oEXP(iPFpfc), if unitary, is indeed dephased 
with respect to Fpk . 

Next we will show that PFpk e Tip k' ^ linear subspace of real p'' x p^ 
matrices, defined in the following Theorem 16. 2| presenting another construction 
of the considered family. From this it will follow that Fpk o EXP {iP Fpk) is 
unitary, as it is shown in the proof of Theorem 16.21 Note that PFpk already 
satisfies the dephasing constraints parltly defining TZp 

To have PFpk £TZp ^ it is enough to show that for p'^ x p'^ PCM matrices 
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^Re''' ^im*'' with the step index j and the cycle index i in the ranges: 



2 



if 



1.. ifp = 2 



and i e < 1, 2, , 



lcm(p'',j; 
3 



{— i) 

P-^l additionally for p = 2 with the cycle index i in the range: 



ze 1,2,, 



- 1 



- 1 



(152) 



(153) 



and such that they satisfy the additional constraints imposed on P in Theorem 
16.11 and (PCM indexing introduced in Definition 15.11 is used): 



p 



P. 



Re 



= 1, 



P. 



Re 



U-i) 



= for other allowed {t,s) ^ t>l, 



for other allowed (t, s) ^ t > 1, 



• if p — 2 then 



P 



Re 



Re 



for other allowed 



{t,s) ^ (2^,z), t> 1, 

(^Re'^V). (^im^^^O ('''''^ (^R^^^'^P^) ifp-2) belongto7^F,. Itis 

because P^;!\ P^^'^ for m a basis of the space of PCM matrices P satisfying the 
constraints of Theorem 16.11 and there are d{Fpk) of them (see the calculation 
of the number of real parameters in a PCM matrix leading to the calculation of 
the defect of in the proof of Theorem 15. 2p . 



The {p^:^Fp^, [pi 



matrices have the properties: 



The only non-zero rows of [^P^^'Fpk j are identical and equal to: 

-2[^^p'']i,+[^P^],+i>[^p''],._,+i,: = -2^e^ + 2Re([Fp.]^.^^^^ 

(154) 

and they are spaced at row index distance gcd(j,p*'') one from the next 
one below. 

The only non-zero rows of (^Pj^'' Fpk^ are identical and equal to: 

0[^P'=]i,+i[j"p^-],+i,-i[^P'=]p'.-,+i,: = -2Im([Fp.]^.+iJ , (155) 

and they are spaced at row index distance gcd(j,p*'') one from the next 
one below. 
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• If p = 2, the only non-zero rows of ( ' Fpk j are identical and equal 



to: 



'l[Fk] +[Fk]j,k = ^e^+[Ffc]pfc (a real one!), (156) 



and they are spaced at row index distance p'"/2 one from the next one 
below. 

Now take any allowed step index j and the corresponding matrix (^P^^''Fp. 

or matrix (^Pj^^ Fpk^ , for any allowed cycle index i. Let gcd(j,p'^) = p"\ m < 

k, i.e. j = ap^^ with a,p relatively prime. 

Since any two non-zero rows of the considered matrix are spaced at a row 
index distance being a multiplicity of p™, the matrix automatically satisfies the 
constraints of order p™, order p"^~^^, order p'^"^ defining TZp ^ iii Theorem 

16.21 For p = 2 and j — p'^/2 ^P4,e ^'-^p*"^ surely satisfies the constraints 

of order p*^^^. The above holds because the respective differences of rows in the 
considered matrix are zero rows in all cases. 

For the other constraints to hold, it is obviously sufficient that the constraints 
of order 1, order p, order p™~^ hold for the universal rows A: 

A = Re([Fp.]^.^^ J or A = Im {[F^k]^^^ ,) . (157) 
The constraints of order p™, with < m < m, require that 

A; = Ai^pk-{,H+i) = A;^2p'=-("+i) = ■ • • = ^i+(^p-i-)pk-{A+i) , (158) 

and note that p58p is true for either definition of A in (|157p . because for the 
allowed (in the definition of 7?.^? ^ ) natural I > 1 and s > 0: 

„fc-(™+i) 



\F k] ■ = \F k] ■ ei2^-''"'-p"""'^"" = \F J 



{— i) \ 

This also appfies to I P-^l ' Fpk | if p = 2. 

From the above we conclude that the space of PFpk , with P satisfying the 
constraints of Theorem 16.11 is contained within TZf k- For the final argument 
that (|150p is indeed a manifold, we refer the reader to the similar one in the 
ending of the proof of Theorem 16. 2[ that follows. See also the remark on the 
possible dimension oiTZp ^. there. 

Another construction of the discussed d[Fpk ) dimensional family stemming 
from Fpk is presented in the theorem below. However, the way in which the 
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free parameters (phases) are scattered around a member matrix of the family 
seems to be more sophisticated in comparison with the pattern of parameters 
in a PCM matrix of the previous theorem. 

Theorem 6.2 Let, for p prime and k G'N such that k > I, TZp^^ he the set of 

all real p'^ x p*' matrices R satisfying the independent constraints (where Aj'-' 
denotes the difference Ri^i — Rj,i): 

the constraints of order p° = 1 : 

forl = l, 2, /-I, 

and for ie {1, 2, ...,(/- 1)} 

(one p'' -element cycle of differences of rows, counting '^). 
the constraints of order p : 

\i,i+P _ \i,i+P _ \i,i+P _ _ \i,i+P ^^P.^\ 

jQj. I = 2, . . . , p^~'^ , 

and for i € UrG{i,...,p} '{r + sp : s € {0, 1, ... , (/"i - 2)}} 

(p p''~^ elem.ent cycles of differences, counting final wrappings). 

the constraints of order p^ : 

A _ \i,i+P^ _ \i,i+P^ _ _ A»,j+P^ (^ei')\ 

~ ^l+pl'-S ~ ^i+2p'=-3 — • • • — ■^i + (p_l)plc-3 (.-^O^J 

j-Q^ ; = 1, 2, . . . , p'^""^; 

and for I G U.e{i,...,p^}V + ■ e {0, 1, • • • , (p'^"" - 2)}} 
(p^ p'^~^ -element cycles of differences). 

the constraints of order : 

A i.i+p" _ A i,j+p'" _ A i,i+p"- _ _ A i.i+p"* j^f:o\ 

— ^i+pfe-(m+l) — ^(+2pfe-(m+l) — • • • — ^;_,_(p_l)pfc-(m+l) IJ-0<JJ 

for 1 = 1, 2, pfe-C^+i), 

and /or i € U.e{i,...,p-^} {r + sp" : s € {0, 1, ... , (p'^"™ - 2)}} 
(p™ p''~™ -element cycles of differences). 

the constraints of order p'^~^ : 

^Y+p'-' = At^'+P"" = A^'+P'" =... = A^'^+f'"' (164) 

for i e ae{i,...,p^-i} + SP"-^ ■■ s G {0, 1, . . . , (p - 2)}} 
^pfc-i p-element cycles of differences). 
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the dephasing constraints: 

i?l 1 — i?2,l — ■ ■ ■ ^ Rpi'.l — Rl,2 — ^^1,3 



(165) 



Then TZp ^ is « d(i^pfc) = ^ ((fc — l)p — /c) + 1 dimensional subspace of 
real p'^ xp^ matrices, and if R^^\ R'-^\..., R^'^'^-^p''^^ form a basis ofTZp , then 



e R 



(166) 



wher 



9i, . . . , (Pd(F 



vecK 



Fpfc o EXP I i ^ (/),- R^'^ 



V 



, (167) 



is a <i{Fpk) dimensional manifold (around wec-^[Fpk)) generated by dephased, 
with respect to Fpk , unitary complex Hadamard matrices, stemming from veC]R(i^pfe ), 
parametrized by function T given by il67\ l. 

Proof 

First we show that Fpk o EXP(ii?) is unitary for any R E TZp j. • That is, that 
for any i < j, i,j G {1, . . . jp'^}, with n furtlicr denoting the difference j — i, the 
entries of the vector of the summands in the inner product: 



[Fpk o EXP(ii?)] . .o Fpk o EXP(ii?) 



^ oEXP (i [a'i^" A^/" ... A;^"]) 
(168) 



where again Aj'-* = Ri^i — Rj,i, all add up to zero. 

Let gcd(p'^,n) = p™, i.e. j — i = ap"'^ with a, p relatively prime. Then, for 
the 'initial index' I = 1,2, .. . and for the 'factor of rotation by 27r' 

r = 0, 1, . . . , (p™ — 1), we have, within the {j — i + l)-th row of Fpk , the groups: 



iPp"] ^1 +\Fpk] +...+ \F„k] =0 

L P ^n+l,gi L P J 71+1,52 ^ 7i+l,5p 



with 



91 

92 

9p 



(l + 1. + 



rp 



(169) 



(170) 



rp 



(l + (p-l)-/-(™+l)) + 



rp 



k — r, 



We are aiming to show that the corresponding groups of A 's in (|168p are groups 
of equal numbers. 
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Note that Aj'-^'s, for the chosen pair oii,j, are subject to the constraints of 
order = 1, order p^, order p™, extended to row index distance j ~i — ap™^ . 
Let the indices g in (|170p be denoted by: 

ffi'^=5i, .9^^=52, (171) 

def 

Then (where we define Mwmod v — v for u,v £ N): 

• on account of the constraints of order 1 A*';"!^) — ^^'(i-, for t E {1, 2, . . . ,p}, 

3t 9t 

where 

) = 5^ ^ mod p^-i , (172) 

(2) 

and gl 's fall into the range covered by the constraints of order p, 

• on account of the constraints of order p A^'^^^ — ^.^'^2) for t e {1, 2, . . . ,p}, 

3t 3t 

where 

and 's fall into the range covered by the constraints of order , 



• on account of the constraints of order ^ A*'L , ^ = A^'L, for t G 

9t 91 

{1, 2, . . . where 

^ j^od/-™, (174) 

and 5('™^^-''s fall into the range covered by the constraints of order . 
It is easy to notice that numbers g''i \ g^\ are all not divided by 



pk-m^ pk-m+i^ ^ pk~i ^ Thus at cach step of the above procedure the sequence 
(7^"^ , • • ■ , 5p"\ , ffp"'' remains a sequence of the appropriate remainders equally 
spaced by pk~{m+i) ^ gQ |-]-^g gnal sequence has this form: 



<7i™+'^ = f+0-/-("+i), (175) 

4™+!) = [ + (p-l)./-(™+i) , 

for some[e {1, 2, . . . ,^'=-('"+1)}. 

On account of the constraints of order p"^ all A^'^-'^^j, for t G {1, ■■■,p} are 

9t 

equal. 

Hence we have obtained that for any / £ {1, 2, . . . and for any 

r G {0, 1, . . . - 1}, with gt's defined in PTO)) : 

A^^ = A;^ = ... = A;^. (176) 
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Taking (|169p into account, the entries of the vector of the summands in the inner 
product (|168p add up to zero, which confirms the unitarity of Fpk o EXP(ii?) 
for any R £ TZp ^ ■ 

The number of independent equations, imposing the constraints of order 1, 
order p, order p''~^ on R for it to belong to TZp ^ reads: 

+ (177) 

1) 1)) + ... + 

which is equal to: 

- + + fc-/-i . (178) 

Taking also the dephasing constraints into consideration, the number of inde- 
pendent parameters in R £ TZp ^ is the difference: 

(/)2 - (2/-1) - ((/)2 - (fc + 1)/ + = 

/-I ((fc - l)p - fc) + 1 - d(Fp.), (179) 

in accordance with formula p43p . This gives us the dimension oiTZp ^ . 

Function J- of (I167P parametrizes a d(Fpk) dimensional manifold around 
vecTniFpk), since 



<5 



= vecR(ii?« oFp.) (180) 

0=0 



are independent vectors in R^^*''')'. In fact, a similar argument leads to the con- 
clusion that J- of (jl67p parametrizes a manifold around any point J-' ^(pi , . . . , 0(J(_f t ) 

Note that although we do not show here explicitly that constraints defining 
TZp k independent, the dimension of TZf k cannot exceed d{Fpk), as the 
dimension of the manifold generated with TZp t., (|166p . cannot be greater than 
that, according to Theorem 14.71 

■ 

As examples, let us examine the d(_Fjv)"dimensional families steming from 
veC]R(i^2'0 a-iid 'veC'^{F^2). We present both forms, featured in Theorems 16.11 
andl6.2[ of these. 
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{a, b, c, d, e) 



|veC]R(F8oEXP(i-P8(a,6,c,d,e)-F8)) : a,b,c,d,e G 

a, &, c, d, e e R > , 



where 



Ps{a,b,c, d, e) 



and 
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c — a + e 



J^i^g (a, 6, c, d) 



jvecR (i^9oEXP(i-P9(a,6,c,d)-i^9)) : a,b,c,d&Wi^ 



(181) 
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where 



P9(a, 6, c, d) = 
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and 



Rg{a,b,c,d) = 
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(186) 



Reasoning very much like in the proof of Theorem 14. 2i one can prove the 
fact stated below about the discussed continuous families stemming from Fpk . 
By 'dephased' matrices we mean dephased with respect to Fpk in the manner 
described in the introductory part of this section. 

Theorem 6.3 There exists a neighbourhood W of veCfi{Fpk) in R^'^p such 
that the only vectors v e yV'\{veC]R(_Fpfc)} generated by dephased unitary complex 
Hadamard matrices: 



V = veC]R {Fpk o EXP(ii?)) , 



whe 



Ri,j ~ Ri,i ~ 0, 



h] e {i-p''}, 
(187) 

are those generated by members oj the continuous d{Fpk)- dimensional family of 
Theorem 1 6. 2i 

^Fpk o EXP(ii?) : R e TZp^^, } , (188) 
where TZp ^ is the d{Fpk)- dimensional linear space defined in Theorem \6.'A 
Proof 

Unitarity of vec^^(u) = Fpk oEXP(ii?) (see ()187|) ) and the dephasing condition 
can be expressed, for vec(i?) e ^ , as the system of equations: 




J G {2, . 

ie{l,. 



(189) 



where g is defined at the end of Section [2721 in ((39)) . and where U is taken to be 
Fpk . The collective system will be denoted by 



ft.(vec(i?)) = 



(190) 



Looking at the form of the differential of g at (see (l40l) and the description 
there) we notice that the differential of ft. at satisfies: 



dim Eho ( ]R(p 



= {p^f-d{Fpk), 



(191) 



as vec(efce"^), k — l..p^ and vec(ee^), I = 2..p'^, spanning a part of the kernel 
of Fk/Q, are no longer in the kernel of Dho. 
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Thus one can choose a y{p'^)^ — d(J^pfc)j -equation subsystem of (|190p with 
the full rank: 

/i(vec(i?)) = 0, where dim (^Z)/io (iR^^'^')^ = {p'' f-d{Fpk). 

(192) 

Therefore system (|192l) defines a d(Fpfc )-dimcnsional manifold around 0, and 
this must be the d(i^pfc )-dimensional linear space 'vec{TZp ^) with TZf ^ defined 
in Theorem O for it satisfies p^ . 

If f e yy and vec^^{v) is a dephased unitary complex Hadamard matrix, 
then veCjj^^(v) = Fpk oEXP(ii?) for some vec(i?) close to 0, and veC]R(i?) must 
satisfy (fTM]) . i.e. i? e TZp^^ - ■ 

7 Conclusions 

In this work we proposed a definition of the defect of a unitary matrix of size 
A'^. This notion is shown to be useful while investigating certain properties of 
unitary matrices. Demonstrating that the defect of any Fourier matrix of a 
prime size is equal to zero we infer that in this case F]\[ is an isolated unitary 
complex Hadamard matrix. This result also allows us to prove that for prime 
dimensions there exists a unistochastic ball around the flat bistochastic matrix 
Jn- 

A positive value of the defect of Fn for a composite N provides a direct 
upper bound for the dimension of an orbit of dephased (and thus locally ~- 
inequivalent) unitary complex Hadamard matrices. Already for = 6 this 
bound, equal to 4, is larger than the dimension D = 2 of the largest orbit known, 
which may suggest that the list of known Hadamard matrices is incomplete. 

The defect of any U may be expressed using the rank of certain matrix asso- 
ciated with U and computed numerically. Such computations were performed 
for several unitaries of size N = 6 belonging to the known families of inequiv- 
alent unitary complex Hadamard matrices. In all cases studied the defect was 
equal to d{FQ) — 4, which provides a hint [3D] that these families may be em- 
bedded inside an unknown orbit of dimension 4. This reasoning allows us to 
believe that the notion of the defect will be useful in further search for new 
families of (unitary) complex Hadamard matrices. 

In this paper we presented two constructions of d(i^Ar)-dimensional smooth 
families of inequivalent complex Hadamard matrices which stem from the Fourier 
matrix F]\[. These constructions work for N being a power of a prime number. 
One of them involves the 'parameter cycle matrices', which proved to be useful 
by computing the defect d{F]\[). The family of complex Hadamard matrices 
obtained in this way has a particularly nice form which is due to the symmetric 
structure of Fn, and is closely related to the fact that Fn diagonalizes circu- 
lant matrices of size TV. Analogous properties of orbits of inequivalent matrices 
stemming from tensor products of Fourier matrices need further investigations 
for other composite N which are not a power of prime. 
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The defect of a unitary matrix is related to the map H]) projecting the iV^ 
dimensional set of unitary matrices into the {N — 1)^ dimensional set of unis- 
tochastic matrices. The actual value of the defect provides a kind of character- 
ization of the space of unitary matrices and allows one to classify its elements. 
For a generic unitary matrix d(t7) = 0, while any deviation from this value for a 
given U confirms certain special properties of the analyzed matrix. For instance, 
we find that the defect of a generic real orthogonal matrix O^v of size N > 2 
is positive and satisfies d(Ojv) > {N — 1){N — 2)/2. Although we have some 
knowledge on the defect of unitary matrices with a tensor product structure 
[53] , the general problem of characterizing a class of unitary matrices of size N 
with a fixed defect remains open. 
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A Notation 

We shall adopt the following conventions: 

Ao B denotes the Hadamard product of matrices A and B 

diag(i;) denotes an iV x diagonal matrix, for an N element vector or sequence 
V, such that [diag(i;)]i_i — Vi 

EXP (A) denotes the entrywise operation exp on matrix A 

Re, Im denotes also the entrywise operations Re, Im on matrices 

^ii:i2ji:j2 dcnotcs & sub-matrix of matrix A 



A- ■ 



A - A 



A - A- ■ 

^12 J 1 ■ ■ • ^12 J2 



If zi = i2 or ji ~ j2 we write zi, ji instead of zi : i2, ji ■ J2j respectively. 
Ck denotes the fc-th standard basis column vector 
e denotes a vertical vector [1, 1, . . . , 1]-^ filled all with ones 
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veC(c(A) ^vec(A)^ denotes the 'row by row' vertical complex (real) vector 
form of a complex (real) N x N matrix A: 



vecc(A) = [Ai,i, . . .,Ai^N,A2.i, 



,A 



2,N, 



■ , An,n'\^ 



We identify R*^ {<C^) with the set of all real (complex) vertical fc x 1 vectors 
(matrices). 

veC]R(yl) denotes the 'row by row' vertical real vector form of a complex N x N 
matrix A: 

Re(vecc(A)) 



veC]R(A) = 



Im(vecc(A)) 



span([;.(5) (^span][^(5)j denotes a complex (real) linear space spanned by vec- 
tors from a set or columns of a matrix S 

nullc (D) (^null-R(D)^ denotes, for an operator or complex matrix D, the com- 
plex space {v £(C^ : D{v) = 0} (^the real space {r e : D(r) = 0}), 
for a given N 

B denotes the set of all real matrices with all row and column sums equal to 
1, for a given size N; this includes bistochastic matrices which contain 
non-negative entries only 

U denotes the set of all unitary matrices, for a given size N 

OL denotes the following function generating indices into a matrix 

(iV- l)iV 



1, 2, 



such that 





(1,2) 






(2,3) 




(2,7V) 




(iV-l,7V) 


a(«,i) 


1 




iV- 1 


N 




2iV- 3 




2 



dnii). 



B Proof of Theorem 15.31 on alternate formulae 
for the defect of the Fourier matrix 
(by Wojciech Slomczyhski) 

a. From Theorem 15.21 and from the symmetry relations 

KT _ 1 

Af-1 



^gcd(7V,0-M Egcd(iV,0 , 



i=\ 



1=1 
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for odd N, and 

N 



1=1 \ 1=1 



for even N, we deduce (jl42p . 
b. From (|142p we get 



N 



d(Fjv) = l-2iV + Egcd(7V,0 
1=1 

= 1 - 2iV + E d • |{/ : 1 < ? < TV and gcd (/, A^) = d}\ 

d\N 

= 1 - 2iV + E d • |{fc : 1 < fc < iV/d and gcd [k, N/d) = 1}| 

d\N 

= 1 - 2iV + ^ d • (A^/d) 



= 7V E'^W^)-2 +1 

= (V'< (Af) - 2) + 1 , (193) 
where ip is the Euler function |331 p. 158] given by: 

if (M) ■.^\{l:l<k< M and gcd {k, M) = 1}| , 
^ is an arithmetic function defined by: 

^ (M) := (M) /M , 
and the Mobius inverse function ■(/;< is given by: 

^< (M) :=E^f^ 



We shall show that 



(194) 



To prove (|194p it suffices to apply the Mobius inversion formula [33l P- 154] 

V(^) :=E^< 
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and to show that 

^{N):=J2Rf^)^,{d) , (195) 

d\N ^ 



where ^ is the Mobiiis function defined as 
From the Euler formula [23 p. 158] 



(— 1)^ d = Y[j=i Pj ' where pj (j = 1, . . . , s) are different primes 
otherwise 



" / 1 



we deduce that 



,(A.,=n(i-i) 



j2 n(i+*-j-'.-^)(-i)'' 

fee{o,i}"i=i ^ n y 

&e{o,i}" \i=i / 



which proves (|195p . and, in consequence, (|194p . 

Now, formula (fT43l) folUows from (fTM]) and (fT93l) . 
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